The SU(3) bosons and the spin nematic state on the spin-1 bilinear-biquadratic 
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A bond-operator mean-field theory in the SU(3) bosons representation is developed to describe 
the antiferro- nematic phase of the spin-1 bilinear-biquadratic model. The calculated static structure 
factors reveal delicately that the antiferro-nematic state may exhibit both the ferro- and antiferro- 
quadruple long-range orders, which is reminiscent of the ferrimagnets or the canted antiferromagnets. 
This result may influence the spin wave theory concerned with this phase. Possible relevance of this 
unconventional state to the quasi- two-dimensional triangular material NiGa2S4 is addressed. 
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I. INTRODUCTION 



The spin-1 bilinear-biquadratic model (SBBM) 

H = J V J2 [ cos <P S i ■ S J + sin <P ( S i ■ Sj) 2 ] (1) 

was put forward long time agoi2^, where Si is the spin- 
1 operator. In one dimension, the phase diagram was 
established^ 6 ^, but there are still some controversies^. 
The phase diagram in two dimensions and above may be 
simpler because of suppression of quantum fluctuations. 
Generally speaking, there are two regimes exhibiting dif- 
ferent types of spin nematic orders: (1) the ferro-nematic 
phase for — 37r/4 < tp < —tt/2 (2) the antiferro-nematic 
phase for 7r/4 < cp < tt/2. Recently the first regime with 
ferro-quadruple long-range order (LRO) attracts much 
attention due to the fact that the Mott insulating state 
was realized in a system of bosonic atoms in an optical 
lattice 9-10,11 . Here we shall study the second regime by a 
bond-operator mean-field theory in SU(3) bosons repre- 
sentation. The unconventional properties of this nematic 
state, such as the absence of magnetic LRO and the gap- 
less excitation, are quite instructive for explaining recent 
experimental observations in NiGa2S^i2*i2ii4. 

In a framework of frustrated SU(iV) model, we ex- 
pressed the SBBM in terms of SU(3) generators and 
proposed an associated bond-operator mean-field theory 
in both bosonic and fermionic representations 1516 . The 
theory is a generalization of the widely used Schwinger- 
boson mean- field theory (SBMFT)A£. The advantage of 
the theory is that we can use it to study either the or- 
dered or disordered phases. In this paper, we shall use 
the bosonic theory to study the unconventional orders 
of the antiferro-nematic states on the triangular lattice. 
It will be shown that the ferro- and antiferro-quadruplc 
LRO's may coexist at low temperature for the quadru- 
ple operators, which is reminiscent of the ferrimagnets or 
the canted antiferromagnets. And the uniform quadruple 
moments may keep nonzero at finite temperatures. These 
two new features enrich our knowledge of the antiferro- 



nematic state of this model. To show the relevance of 
this state to the observations in NiGa2S4, we also calcu- 
late the physical quantities, e.g. the ground energy, the 
specific heat, and the uniform magnetic susceptibility. A 
similar theory with a different scheme had been applied 
to the ferro-nematic phase by one of the authors in a 
previous work 8 . 

The paper is organized as follows. In Sec. II we in- 
troduce the SU(3) boson representation for spin 1 sys- 
tem, and express the Hamiltonian of Eq. Q in terms 
of SU(3) generators. In Sec. Ill, we present the formal- 
ism of the bond-operator mean-field theory in bosonic 
language. Then in Sec. IV, we work out the mean-field 
equations and uncover some properties of the antiferro- 
nematic phase. In Sec. V, we present discussions of our 
results. 



II. SU(3) BOSONS REPRESENTATION 

In SBBM, each site has three states, \m a ) with mi = 
— I,m2 = 0, and 7713 = +1, according to the eigenvalues 
of the ^-component of spin, S z . We reorganize the three 
states and introduce three bosonic creation operators, 



b\\0) = ^=(\ mi )-\m 3 )), 
6 2 |0) = -^(K) + |m 3 )), 

b\ |o> = K) . 



(2a) 

(2b) 
(2c) 



In terms of b operators, the eight generators of SU(3) 
group can be expressed by three boson operators. They 
can be divided into two categories, the spin operators 



(3a) 
(3b) 
(3c) 
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In this case the Hamiltonian, Eq. QJ, can be expressed 
in terms of these generators and has a form of the gener- 
alized frustrated SU(3) modeli&, 



(ij) (ij) i \ H ) 

(5) 

where 

Ti(i,j) = Ji^J^J^rj), (6) 

T 2 (i ) j) = -J 2 ^^(r i )^(r i ) ) (7) 

with Jx = J^, cos 99 and J 2 = J^, (cos ip — sin y>) . J^ir.i) — 

b[J>iv are the generators of the SU(3) group, and the La- 
grangian multipliers are introduced to realize the sin- 
gle occupancy of the bosons at each lattice site. The first 
term in Eq.© possesses the SU(3) symmetry because the 
operator, 

E^n^Ifo)^, (8) 

serves as the permutation operator, which swaps two 
quantum states at sites i and j, 

P lj \i,n;j,u) = \i,v;j,fi) . (9) 

The second term in Eq.© breaks the SU(iV) symmetry 
on the triangular lattice. 

III. MEAN-FIELD THEORY 

A. Decomposition Scheme 

Now we concentrate on the regime with J\ > and 
J 2 < 0. In the boson representation, we introduce two 
types of bond operators 

&ij,nu = b jfl b iv - bj U bin, (fi<u), (10a) 
Sij, P u = b]^b w - b] v bin, (n<u), (10b) 




FIG. 1: (Color online) The lattice we used in the calculation, 
which is topologically equivalent to the triangular lattice given 
that the interactions along directions, Sj, 82, and Sj + 62, are 
equal. On this lattice, the first Brillouin zone is a square with 
volume (2ty) 2 . 



and the four-operator terms in the Hamiltonian Eq. © 
can be written as 

Ti = -Ji A L" A «>* + J i> ( iia ) 

T 2 = - |J 2 | -k^ij,^ + \J*\ • (Hb) 

Notice the single occupancy constraint, J^K^bi^ = 1, is 

used when the expressions are deduced. Consider that 
the model is isotropic, one can introduce two real mean- 
field parameters 

A = (A y -,^> - (A].^) , (12a) 
S=(E ij , ltv ) = (s\ jtttv ). (12b) 

The prescribed mean fields represent the ultrashort-range 
correlations. However, when the mean field equations are 
solved, some physical restrictions should be fulfilled. For 
instance, the biquadratic term in the SBBM (N = 3) can 
be written as 

{Si ■ Sj) 2 = -^2 + !. (Mi v = 1,2,3). 

(13) 

Since (Si ■ Sj) ^ 0, one would obtain the restriction 

S = (E ij>fiU ) < -±=. (14) 

Our numerical result shows that this restriction is well 
satisfied. 



B. Mean-Field Equations 

We limit our calculation on the triangular lattice (see 

Pig. nj. 

The Hubbard-Stratonovich transformation is per- 
formed to decouple the Hamiltonian Eq. I© into a bilin- 
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ear form 

[i<v i,S>0 



|7V A iV (JiA 2 + | J 2 | S 2 ) + A]T £ b l b ^ - XN ^ 

(15) 



where X)«5>o mcan s summation over the nearest neigh- 
bours in the positive directions of a given site, -/Va is the 
total number of lattice sites, z is the coordinate number 
of the lattice, e.g. z = 6 for the triangular lattice. 

After performing the Fourier transform and introduc- 
ing the Nambu spinor in the momentum space, 



( b k,V b k,2> b k,3> b -kA> b -k,2,b- K3 ^ . (16) 



one can arrive at the mean-field Hamiltonian for the spin 
S chain in a compact form, 



(17) 



where 



A k = 2J 1 Ar] k ,^ k = 2 |J 2 | ^k,Vk = E sinfc <5 ( 18c ) 

S>0 



£o = ^zN A ( Ji A 2 + | J 2 | S 2 ) - ^XN A . 



(18d) 



By diagonalizing the Hamiltonian, we get three spectra, 
wi (k) = A, (19a) 
Lu 2 (k) = J(\-V3Z k ) 2 -(V3A k ) 2 , (19b) 



w 3 I 



(k) = J(\ + V3E k ) -(VSA 



(19c) 



Notice that the two spectra (J3 (k) and w 2 (k) has a re- 
lation of LU3 (—k) — loi (k). By optimization of the total 
free energy 

F = e ° - \ £ ln t ns ("v ) ( ns + ' ( 2 °) 

where ub (<*v) is the Boltzmann distribution function, 



three mean-field equations are established 

d 2 k 1-Er) k ^/?55 2 (fc) 
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3y/3J (2tt) 2 55 2 (fc) 



■ coth : 



(21a) 
(21b) 

(21c) 



in which we have introduced dimensionlcss quantities for 
convenience of calculation 
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In order 



And /3 = 1/ksT, ks is the Boltzmann constant. There 
are generally three branches of valid solutions: (i) non- 
zero solution, A^O and 2^0; (ii) zero solution, A = 
and S /: 0; (iii) zero solution, A 7^ and S = 0. The 
one with the lowest energy is picked out as the physically 
realized state. At zero temperature, the per site ground 
energy has a simple form, 

^ = -^(j 1 A 2 + |J 2 |S 2 ). (23) 



Green's Function and Susceptibility 



the Matsubara Green's function in the form of a 6 x 6 
matrix, 

G(k, r) = - (T T <5> k (r) (0)) = - £ G (fc, iu n ) e"^. 

n 

(24) 

The bosonic Matsubara Green's function G(k,iu> n ) is 
generally worked out as, 



G (k, iuj n ) = (iu n cr z ® A - M k )~ 



(25) 



where u> n = 2n7r//3. The three spectra, Eq. H19(l . can 
also be read out from the poles of the Green's function. 

As we shall study spin order as well as the nematic 
order in the system, we define two types of correlation 
functions in Matsubara formalism. The first type is the 
spin-spin correlation. Due to rotational invariance, we 
need only to consider the imaginary-time spin-spin cor- 
relation for S z , 

Xs>{q,r) = (T T S z (q,r)S z (-q,0)). (26) 
Its Fourier transform is given by 

XS>{q,iui n ) = / dTe^ T xs>{q,T). (27) 
Jo 



4 



The second type is the imaginary-time quadrupole- 
quadrupole correlation and its Fourier transform defined 
for the quadrupole operators Q's in Eq. (@J is given by, 

Xq(3,t) = (T T Q{q,T)Q(-q,Q)) , (28) 

XQ (q,^n)= dre^ T x Q {q,r), (29) 
Jo 

Qe{Q {0) ,Q {2) ,Q xy ,Q yz ,Q zx }. (30) 

Due to the rotational invariance, here we only present 
two of them, XqW an d XQ* V (Xq(°> i s equivalent to Xq( 2 ) > 
XQy* and XQ z * are equivalent to XQ* y )- According to the 
single-mode approximation theory 18 , xs z is related to the 
spin order by the single mode S z (q) |0) with spin density 
wave 

S z (q) = J2^' Ri Sr, (31) 

i 

while xq is related to the nematic order by the single 
mode Q(q) |0) with quadrupole density wave 

Q(q) =J2 eiqRi Qi- ( 32 ) 

i 

The expressions of the susceptibilities at zero tempera- 
ture can be found in Appendix. A. 



Po 




7T/4 3/T/8 7T/2 

FIG. 2: The condensation density po at zero temperature. 
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IV. LONG-RANGE SPIN NEMATIC ORDER ON 
TRIANGULAR LATTICE 

The non-zero solution of the mean field parameters 
satisfies 



FIG. 3: (Color online) The ground energies. The solid line 
is the non-zero solution: A 7^ 0, S 7^ 0. The dashed line 
is the zero solution: A 7^ 0, 3 = 0. The dotted line is the 
zero solution: A = 0,S / 0. This figure shows the non-zero 
solution is the optimized one. 



A + S = 



3^3' 



(33) 



at zero temperature and on the triangular lattice. With 
this relation, the spectrum w 2 (k) becomes gapless at the 
point, 



k* — (fc*, - ( — , ~ 



(34) 



where the boson condensation occurs. As temperature 
becomes nonzero, the spectrum u 2 (k) will open a gap 
and thus no condensation occurs. When the condensa- 
tion occurs, we should parse the condensation terms and 
rewrite the equations as 



d 2 k 1 - S rj k 
(2tt) 2 252(A) ' 
1 f d 2 k A rg 



Po = 2- 



A 2 P0 • 2,ViJ (2^) 2 £ 2 (fc)- 



1 



1 



d 2 k 



Vk Vk 



3^7 (2tt) 2 



w 2 (k) 



(35a) 
(35b) 

(35c) 



where the condensation density is (see numerical result 
in Fig. 01 



Po 



2n B (gg (k*)) + 1 
N A u 2 {k*) 



(36) 



From the ground energies shown in Fig. [21 
we see the non-zero solution is the optimized one in the 
range 7r/4 < tp < it/2. At the SU(3) point of <p = it/A, 
the zero solution with A / and S = is degenerate 
with the non-zero solution. At the point of ip = tt/2, 
the zero solution with A = and S 7^ is degenerate 
with the non-zero solution. This reflects the fact that 
the two points are highly symmetric points. In the range 
7r/4 < ip < tt/2, the condensate is non-zero. So what is 
the physical effect of the quasiparticle condensation? By 
probing the possible orders in the system, we find the con- 
densation leads to the nematic LRO while spin moments 
vanish, i.e. the nematic state is non-magnetic. This con- 
clusion is drawn from the static spin and quadrupole 
structure factors shown in Fig. (Please refer to the 
expressions listed in Appendix. A.) 

The static quadrupole structure factor Xq( 2 ) (Qj t = + ) 
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Xs- L 




Xo^".2 





FIG. 4: (Color online) Static structure factors xs* , Xq( 2 ) i an d 
XQ^y a t a sampled point ip — 0.863938. The images at other 
point in the regime j < ip < £ are qualitatively the same. 



and xq^y(<z, t = + ) show sharp divergent peaks at the 
two points q* = ±2k* = ± ^) indicating the exis- 
tence of antiferro-quadrupole LRO. While the static spin 
structure factor xs z {q, T = + ) shows two small humps 
at q* = ±(^-,?f). Surprisingly (?, t = + ) also 
exhibits a divergent peak at the point q° — (0,0). An- 
alytically, at the condensate points, the divergent terms 
of XQ*y are parsed out as (obtained by taking the limit 
T — > in the finite temperature results) 



1 



(37a) 
(37b) 



The ratio of the weights of the ferro- and antiferro- 
quadrupole divergent peaks is 



PO 



(9°) 



PO 



(q* 



(38) 



Xq"v(q ) an d Xq^v{<1*) are proportional to the number 
of the lattice site iVjy, which indicates that the ferro- and 
antiferro-quadrupole LRO coexist for Q* y ■ The result 
can be understood well if one notices that the states de- 



fined in Eq. © are eigenstates of , 



Q 



(2) 



,(2) 



If on a bipartite lattice, 



410). 



(39a) 
(39b) 
(39c) 



,(2) 



1 ) and 



Q 



(2) 



1 



would align in a staggered pattern with antiferro- 
quadrupole LRO in the classical point of view. While 
on the triangular lattice, the LRO arrangement of 

quadrupole moments, (Q^^, is a 2n/3 structure as we 

revealed above. Nevertheless they are not the eigenstates 
of Qi V , instead 



(2) 



-1 



,(2) 



1 

71 
-i 

71 



(\Q- 



i) 



-1)), (40a) 
-I))- (40b) 



(2) 

So the antiferro-quadrupole moment of Q\ means the 
existence of both the ferro- and antiferro-quadrupole mo- 
ments of Q^ v ■ This phenomenon is reminiscent of the fer- 
rimagnets or the canted anteferromagnets, which exhibit 
both ferromagnetic and antiferromagnetic orders. 

Now we address to the two terminals of the range 
tt/4 < ip ^ 7r/2. At the SU(3) point p = tt/4, the 
static spin structure factor also becomes divergent at 
q* = ± The state is degenerated with the ne- 

matic phase, which reflects the higher symmetry of the 
system 1 ' 2 . At ip — ir/2 where the Hamiltonian becomes 
H = Yliji^i ' ^j) 2 ' au °f the static structure factors van- 
ish and the system is free of both spin and quadrupole 
moments, which means the system is totally disordered. 

The Matsubara formalism facilitates the evaluation of 
the expectation values at finite temperatures (tt/4 < tp < 
t/2), 



bl h 



bLb 



bl h 



iVil 



Thus we obtain 



btbn 
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3' 

1 1 

6 ~ 2 



n B (A) 



(SI 

-)(2) 



= 0, 

= o, 



(Q?) = 



i 



- n B (A) 



(41a) 
(41b) 

(42a) 
(42b) 

(42c) 



The uniform quadrupole moment (Q^ v ) keeps nonzero 
at finite temperatures. This result does not mean the 
finite-temperature phase transition, just shows a robust 
uniform quadrupole moment. 

It is well known, for the noninteracting Bose gas in 
three dimensions, the density of states (DOS) will vanish 
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7i/4 3/T/8 

FIG. 5: The coefficient a in Eq. JSJ. 
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FIG. 6: The magnetic susceptibility \m at zero temperature. 



with the energy decreasing down to zero, i.e. D (E) ~ 
\f~E~ — > when i? — * 0, which leads to the Bose conden- 
sation at the gapless point E = at low temperatures. 
The situation is similar here. The DOS is defined by 



(43) 



k . j-i 



Since there exist a flat band uj\ = A for quasi-particlcs, 
D(E) always has a divergent peak at E = A. We find 
that DOS rises linearly in E from zero in the range of 
it /A < ip. < tt/2, 



£>(£) - a{p)E + 0(E 2 ), 



(44) 



because the gapless spectrum u>2 (k) exhibits a node at 
k* = (f , |). By the DOS in Eq. gtj, the low tempera- 
ture specific heat is shown to exhibit the law of T 2 , 



C v = 



2 -^a^)k 2 B T 2 . 



E 



2k B T 



(45) 



The coefficient a (ip) is plotted in Fig. OD 

While at the terminal <p — tt/2, the node of the spectra 
disappears and the DOS has the form D (E) ~ b + cE 

2 

with b ^ 0, then one would get CV ~ ^bksT. 

It is noteworthy that, at nonzero temperatures, the 
spectrum 0J2 (k) is gapful and the DOS always has 
D (E) r~j b + cE. But at very low temperatures, b is 
quite small and the power law in Eq. I|45(l can be satis- 
fied asymptotically. 

The uniform magnetic susceptibility at zero tempera- 
ture is obtained by Kramers-Kronig relation^ 



1 f°° Imxs^u) 
Xm = hm - / duj 



or by analytic continuation's 



Xm = Hm lim xs*(q,iu n ), 

q—>Q ioj n — >0 



(46) 



(47) 



They give the same result. At zero temperature, xm 
versus ip is illustrated in Fig. HjJ 

Xm reaches the maximal value at the SU(3) point tp = 
7r/4, while it approaches zero at the end point p = tt/2 
where the system is inert to the external inspiration. 



V. DISCUSSION 

Recently the insulating antiferromagnet NiGa2S4 
arouses much attention 1 -. The spin disorder observed 
in the experiment suggest that it may be a realization of 
the conceptual spin liquid that has long been explored 
over the past decades. This chalcogenide has a stacked 
triangular lattice with weak interactions between layers. 
Strong Hund's coupling in Ni 2+ '{t^e 2 ) leads to the mag- 
netism with spin S = 1. Magnetic neutron scattering 
shows absence of conventional magnetic order and ex- 
cludes the possibility of bulk spin glass freezing at low 
temperatures. Its specific heat shows low temperature 
power law, Cv ~ T 2 , indicating gapless excitations and 
linearly dispersive modes in two dimensions. No diver- 
gence was observed for the magnetic susceptibility with 
the temperature decreasing down to 0.35K. These fea- 
tures can be produced by the nematic state as we studied 
above. However the incommensurate short-range order 
observed in the experiment still remains untouched. 

Our bond-operator mean-field theory has the same ori- 
gin as the SBMFT and is superior to the molecular- 
field approximation (MFA) because the MFA starts from 
a prescribed ferro- or antiferro-order and produces the 
same result regardless of the dimensionalitjtSiSii, while 
the our theory has no bias on the order or disorder of 
the ground state in advance. In two dimensions, we got 
a gapless nematic phase with quadruple LRO as we il- 
lustrated above for the triangular lattice. In one dimen- 
sion, we got a gapped nematic phaseSi. Nevertheless, 
any mean-field theory can not be conclusive in its own 
right, thus other methods for the same problem are de- 
manded. Unlike the spin wave theory, the bond-operator 
mean-field theory used in this paper does not prescribe 
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an ordered state in advance. It has the same origin as 
SBMFT, except the species of bosons is altered from two 
to three. The antiferro-quadruple LRO emerges as a con- 
sequence of the condensation of the SU(3) bosons. Our 
results also show the quadruple operators are divided into 
two types. They have different LRO patterns and should 
be considered differently in a spin wave theory (i.e., for 
and Q^ 2 \ one need only to consider their antiferro- 
orders; while for Q xy , Q yz , and Q zx , one should consider 
their ferro- and antiferro-orders at the same time. The 
coexistence of ferro- and antiferro-quadruple LRO's re- 
veals that the quadruple operators can not be considered 
as the analogues of spin operators in the magnetic LRO 
phenomena. And as a merit of bosonic language, we ex- 
pect that this theory gives good estimation of ground 
energy values (see Fig. EJ, like the SBMFTS22. To see 
how this theory describes the antiferromagnetic phase 
(— 7r/4 < ip < 7r/4) of the SBBM is also desirable, which 
will be considered in our future work. 

In summary, a SU(3) bosons representation is intro- 
duced and the associated bond-operator mean-field the- 
ory is established to describe the antiferro-nematic phase 
of SBBM. It is revealed delicately that this nematic 
state may exhibit both the ferro- and antiferro-quadruple 
LRO's, which is reminiscent of the ferrimagnets or the 
canted antifcrromagnets. And the quadruple LRO may 
survive to finite temperatures. The system may provide a 
rare example exhibiting finite-temperature phase transi- 
tion in two dimensions. Possible relevance of this uncon- 
ventional state to the quasi-two-dimensional triangular 
material NiGa2S4 is addressed. 

This work was supported by the Research Grant Coun- 
cil of Hong Kong under Grant No.: HKU7038/04P. 
APPENDIX A: STATIC SPIN AND 
QUADRUPOLE STRUCTURE FACTORS 

The static spin and quadrupole structure factors at 
zero temperature, x{q> t = + )> are worked out as 

Xs*M+) = J -^[A 2 (k) + A 3 (k) 

+ 3A 2 (k) B 2 {k + q) + 3A 3 (k) B 3 (k + q) 
+ 3C 2 (k) C 2 (k + q) + 3C 3 (k) C 3 (k + q)}, 

(Ala) 

d 2 k 



where the abbreviated notations are 



Xq(2) (<2S ) 



+\ - 



■[A 2 (k) + A 3 (k) 



3A 2 (k) B 3 (k + q) + 3A 3 (k) B 2 (k + q) 
3C 2 (fc) C 3 (k + q) + 3C 3 {k) C 2 (k + q)], 

(Alb) 



XQ-y(q,0 + ) 



d 2 k A 



A 2 (k) + ]-A 3 (k) 



- A 2 (k) B 2 {k + q)+ A 3 (k) B 3 (k + q) 
AA 2 (k) B 3 {k + q)+ 4A 3 (fc) B 2 (k + q) 
AC 2 (k) C 3 (k + q)+ AC 3 (k) C 2 (k + q) 
C 2 (k)C 2 (k + q)-C 3 (k)C 3 (k + q)}, 

(Ale) 



A 2 (k) 
A 3 (k) 
B 2 (k) 
B 3 (k) 

C 2 (k) 
C 3 (k) 



A - \/3Sk 



u 2 (k) 
A + V3~ k 



1 - 



uj 3 (k) 
A — \Z33jij 



= A 2 (-k) , 



lu 2 (k) 
A + V3S fe 



w 3 (k) 



B 2 (-k). 



l \/3A k 
6 lu 2 (k) ' 
1 V^Afc 
6 uj 3 (k) 



= -C 2 (-k) . 



(A2a) 

(A2b) 

(A2c) 

(A2d) 

(A2e) 
(A2f) 



and Afe can be found in Eq. I|18cf> . Note that 
for xq( 2 )(9j0 + ) an d XQ X " (?) one should consider 
the divergent terms at the points q* = ± (=^-, and 
q° = (0,0), such as Eq. (E3). 
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